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ABSTRACT 


In  this  paper,  the  so-called  local  likelihood  method  Is  suggested 
for  solving  the  change  point  problems  when  the  data  are  distributed  as 
multivariate  normal.  The  detection  procedures  proposed  not  only  provide 
strongly  consistent  estimates  for  the  number  and  locations  of  the  change 
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1.  INTRODUCTION 


Recently,  considerable  attention  has  been  devoted  to  change  point 
problems.  These  problems  originally  arise  in  various  fields  such  as  eco¬ 
nomics  and  Industrial  quality  control.  They  are  also  related  to  the  prob¬ 
lem  of  edge  detection  (see  Mazumdar,  Sinha  and  Li  (1985)). 

When  the  underlying  distribution  of  the  data  is  normal,  the  change 
points  are  characterized  by  those  of  the  mean  function  and/or  covariance 
matrix  function.  In  Section  2,  we  list  five  cases  we  are  Interested  In. 

Some  authors  studied  the  change  points  of  the  mean  function  or  re¬ 
gression  function  when  the  data  are  distributed  as  normal.  The  related 
literature  Is  quite  extensive.  Most  of  these  authors  only  considered  the 
cases  when  there  is  at  most  one  change  point  or  the  number  of  the  change 
points  Is  known.  Here  we  quote  the  papers  Hinkley  (1970),  Sen  and  Srl- 
vastava  (1973,  1975),  Vostrikova  (1981)  and  Schulze  (1982). 

Generally,  the  number  of  change  points  may  be  unknown.  For  this  case, 
Krlshnaiah,  Miao  and  Zhao  (1986a,  1986b)  Investigated  the  detection  of  the 
number  and  locations  of  change  points  for  the  mean  functions  using  infor¬ 
mation  theoretic  criteria.  However,  the  computations  of  these  methods  are 
too  much  when  there  are  many  change  points.  Later,  Yin  (1986)  proposed  a 
nonparametrlc  method  so  as  to  save  the  computation. 

In  this  paper,  we  use  so-called  local  likelihood  to  detect  the  number 
and  locations  of  the  change  points  when  the  data  are  distributed  as  multi¬ 
variate  normal.  One  of  the  conspicuous  merits  of  this  method  Is  that  It 
has  much  less  computation  In  applications.  Besides,  the  detection  pro¬ 
cedures  are  strongly  consistent. 

The  problems  are  proposed  In  Section  2  and  the  various  cases  are 
treated  In  Sections  3-6  respectively. 
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■  2.  THE  PROBLEMS  CONSIDERED 


Let  X(t)  be  an  Independent  p-dlmensional  process  on  (0,1]  such  that 

X(t)  .  y(t)  +  V(t),  0  <  t  <  1,  (2.1) 

where  V ( t)  Is  an  Independent  p-variate  normal  process  with  means  0  and 
covariances  A(t)  >  0,  y(t)  is  a  pxl  real  vector  function.  The  problems  to 
be  considered  can  be  formulated  as  the  following  five  forms. 

Case  1.  y(t)  is  a  left-continuous  step  function  with  the  jump  points 
t-j  <  ...  <  tq,  which  are  called  the  change  points  of  the  mectn  function  of 
X(t),  and  A(t)  ■  A  >  0  for  t  e  (0,1],  where  A  is  an  unknown  matrix. 

Case  2,  y(t)  Is  a  left-continuous  step  function  with  the  change  points 
— 

mentioned  above.  Write  tQ  a  0  <  t-j  <  ...  <  tq  <  tq+^  =  1.  We  assume  that 
A(  t)  *  Aj  >  0  for  t  e  (tj_<|,  tj],  j  *  1 ,2,...,q+l ,  and  A-j ,  ...,  Aq+1  are  all 
unknown. 

Case  3.  A(t)  >  0  Is  a  left-continuous  step  function  with  the  jump 
points  t^  <  ...  <  tq,  which  are  called  the  change  points  of  the  covariance 

function  of  X(t),  and  y(t)  =  y  for  t  e  (0,1],  where  y  Is  unknown. 

Case  4.  p  *  1 ,  y(t)  Is  a  left-continuous  step  function  with  the  jump 

points  t1  <  ...  <  tq,  and  A(t)  *  A  >  0  for  t  e  (0,1].  Write  0  *  tQ  <  tj  < 

...  <  tq  <  tq+j  a  1,  we  assume  that  y(t)  =  y^  for  t  e  (tj_j  tq]  and 

U1  >  y2  >  >  Mq  >  Vl* 

Caee  S.  p  *  1,  y(t)  satisfies  the  conditions  in  the  Case  4,  and  a( t)  * 
Aj  >  0  for  t  e  (tj_p  tj]. 

In  the  above  cases,  we  assume  that  the  number  q  of  the  change  points 
Is  unknown.  We  want  to  determine  q  and  the  location  of  t^ ,  tg.  ...»  tq, 
based  on  the  data  X(1/N),  1  *  1,2,...,N. 
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3.  THE  CASE  1 

Ptit  X,  =  X(^);  Take  a  positive  integer  m  <  N.  For  k  =  m,m+l,...,N-m, 

consider  *  ~ k-m+2 *  •••»  •••*  2 k+m ”  assume  that 

X^,  1  =  k-m+1 ,. .. ,k+m,  are  independent  p-variate  normal  variables  such 

that 


EX 


k-m+1 


■  . « «  =  E  X I.  ~  y 


=  ..0) 


E*k+1 


=  =  EX  =  u(2) 

-k+m  ^  * 


and 


Var<?k-n»l)  ■  ••• *  Var(W  ■  A  >  °- 

where  y^,  y^  and  A  are  all  unknown.  Put 

mm  mm 

F(l,k)  “  in  2(l,k)2l»  1(2, k)  =  in  £(2.k)£i* 

3(k)  =  2i£(k)*l» 


(3.1) 


(3.2) 


(3.3) 


where  ^(1 ,k)  =  ^1=k-m+l*  ^ (2 ,k)  =  ^i^k+r  ^(k)  =  ^1=k-m+l*  Then’  the 
logarithm  of  the  likelihood  ration  test  (LRT)  statistic  for  testing  the 

null  hypothesis  H^:  y^  =  y^2^  against  the  alternative  K k:  y^  ?  y^ 

is  given  by 

GN(k)  =  m  log|Ak>N|  -m  log | Bk^N | ,  (3.4) 

and 

1 


Jd.kJ^ii'id.O^if^l.k)^  +  ^2,k)^l*’2(2tk)^1"^(2,k)^'J  ’ 
Bk,N  "  5m  J(k)^1  ‘?(k)^2i  "  2(k)^'* 


*,N  "  5m 
1 


(3.5) 


Take  m  ■  m^  and  positive  number  such  that 


niwirvtcwwwwwiww  jurhh- 

5 

N  »  m  »  C^  >>  log  N. 

(3.6) 

Hereafter,  «N  »  eN  means  11m  a^/e^  =  ». 

Def i ne 

1 

t 

Dfl  ■  { k :  k  *  m,  m+ 1,  ■  . . ,  N~m ,  - (k)  >  C^ }  • 

(3.7) 

Assume  that  k1  N  =  m1n{k:  k  e  0N>.  Define 

- 

°1,N  =  ke  Dn,  k-  N  <  3m}. 

(3.8)  j 

Assume  that  k^N  =  m1n{k:  k  e  DN  -  Dj  N}.  Then  we  define 

t 

°2,N  {k:  k  e  DN‘D1,N*  k  “  k2,N  <  3m}* 

(3.9) 

Continuing  this  procedure,  we  obtain 

°N  =  °1,N  +  °2»N  +  *•*  +  Dq,N* 

(3.10) 

and  every  ^  Is  not  empty.  Put 

‘j  *  3T  fkj.N  *  max(k:  k  e  Dj,N>]*  J  '  1 . 

(3.11) 

then  we  can  use  (q,t^ ... . ,tq)  as  an  estimate  of  (q,t^,...,t  ). 
the  following: 

We  have  ; 

THEOREM  3.1.  Under  the  conditions  of  the  Case  1,  (q,tj,... 
a  strongly  consistent  estimate  of  (q.t-j ,. . .  ,tq). 

•*q)  1s 

We  need  the  following: 

LEMMA  3.1.  Let  x.|,  Xg,  ...»  xn  be  1.1. d.  random  variables 
Ex.j  *  0,  and  $(t)  «  E{exp(tXj)}  Is  finite  In  a  neighborhood  at  t 
Then  for  any  given  constant  e  >  0, 

such  that 

-  0. 
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1 

By  (3.4),  (3.14),  (3.15)  and  y.  / 

-GN(k®)  >  c^m  for  some  constant  c^.  >  0.  (3.16) 

By  (3.16)  and  m  »  C^,  with  probability  one  for  N  large, 

kj  6  °H*  j  =  1,2 . q*  (3.17) 

By  the  definition  of  Dj  N's,  noting  (3.12)  and  m  «  N,  we  see  that  with 

probability  one  for  N  large,  k? . k^  belong  to  different  D.  N's,  which 

implies 

Qiq.  (3.18) 

Take  e  (0,1/2).  Write 

Kn  =  {k:  m<k<N-m,  |£-  tj (  >  j|(l  +  for  j  =  1,2 . q).  (3.19) 


yj+1»  with  probability  one  for  N  large. 


Assume  that  k  e  K^.  By  m  «  N,  It  is  easily  seen  that  (3.1)  and  (3.2)  hold 
with  =  j/2^  =  iij  for  some  j  =  l,2,...,q+l  and  N  large. 

For  a  pxp  matrix  A  =  (a^),  we  write  ||A||  =  (^  .  la^.  |2)172  and  use 
X^(A)  >_  Ag( A)  _>  ...  >_  Ap( A)  to  denote  Its  eigenvalues.  Also,  we  write 
lls II 2  -  la-|  1 2  for  a  =  (a1#...,Op)'. 

By  (3.5), 

1  •  \  2 

Ak,N  =  2m  ^(k)^Jl  ” Hj^Jl  •  “  2  ^^(v.k)  “  Hj)(?(v,k)  “  Hj> ' 

=  Ak,N  "  ^k,N*  ^3,2°^ 


By  Lemma  3.1,  for  any  e  >  0,  there  exist  constants  C  >  0  and  C-|  >  0  such  that 


Pll|AkiN-MI  ic>  <  V0”. 
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which  imply  that  for  any  e  >  0, 


H\,N  ”  ^11  —  <  ^le 


(3.21) 


Hereafter  we  will  use  C  and  for  some  new  positive  constants  without 
statement. 

It  is  well-known  that  for  any  p*p  symmetric  matrices  A  and  B, 


tr  AB  <  l  X . ( A) X . (B) 

”  i=l  1  1 

(von  Neumann  (1937))  which  Implies  that 


‘  Xi<A>)2  -  tr^Ak,N" 


By  (3.21)  and  (3.23), 


By  (3.5), 


P{xp(AkV  K  Cle‘Cm* 


"  Ak,N  *  3^(1, k)  "  $(2,k)^3f(l,k)  "  -(2 ,k) ^ '  -  0 


By  (3.4),  (3.22)  and  (3.25), 

-GN(k)  =  m  log|Ip  +  Ak|^2(Bk^N -  AkjN)Ak|jJ2| 

tr  AkVBk,N"\,N)  tr(Bk,N-Ak,N)/Xp(Ak,N) 

=  5llJ(l,k)  "I(2,k)H2/Xp(Ak,N)* 

Assume  that  y^  =  N (0 , 1 ) .  Then  for  N  ^  3, 


P(|yN|  >  S5  log  N)  <_ 


exp(-3  log  N)  <  N  . 


(3.22) 


(3.23) 


(3.24) 


(3.25) 


(3.26) 


(3.27) 
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Since  vfr(X,  .x-y.)  -  N(0,a)  for  v  =  1,2,  It  is  easily  seen  that  if  we 

~\V»K/  -J 

take  the  constant  C2  large  enough. 


p<Tll5(i,k)-!i(2,k)ll2^c2l09N)  ' 2N'3' 


(3.28) 


By  (3.26),  (3.24)  and  (3.28),  noting  »  log  N,  we  have 


(>{-GN(k)  >  CN)  <  C^(e"cm  +  N'3), 


(3.29) 


Note  that  C-j  and  C  are  the  same  constants  for  all  k  e  and  #(KN)  <_  N. 
Thus 


t>{-GN(k)  >  CN  for  some  k  e  KN>  <  C1(Ne"cm  +  N“2), 


(3.30) 


which  is  a  general  term  of  a  convergent  series  by  m  »  logN.  Use  Borel - 
Cantelli's  lemma,  with  probability  one,  we  assert  that  for  large  N 

(3.31) 


n  Km  =  0. 


By  the  definition  of  D.  N's  and  the  fact 

j 

2m(l  +  e^)  <  3m, 

with  probability  one  for  N  large, 

q  <  q.  (3.32) 

From  (3.18),  (3.32)  and  (3.31),  It  follows  that  with  probability 
one  for  N  large 

q  =  q.  (3.33) 

and 


11m  t.,  =  t.  a.s.,  j  =  l,2,...,q. 

N-*»  J  J 


(3.34) 


Theorem  3.1  is  proved. 
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4.  THE  CASE  2 

Take  =  X(i),  i  =  k-m+1 ,  k-m+2 ,  ...»  k+m.  For  k 
suppose  that  (3.1)  and  the  following  hold: 

Var*Jk-im-l*  =  "•  =  Var<ik>  =  *  0> 

Var(Xk+,)  =  ...  =  Var(Xk+m)  =  a(2)  >  0. 


=  m,  m+1 ,  . . . ,  N-m, 


(4.1) 


where  y^,  y^,  A^  and  are  all  unknown.  Continue  to  use  the 
notations  of  (3.3).  Then,  the  logarithm  of  the  LRT  statistic  for  testing 
the  null  hypothesis  Hk:  y^  =  y^  and  A^  =  A^  against  the  alternative 
K.  :  y^  t  y^,  A^  and  A^  are  arbitrary  is  given  by 

K 


GN(k)  =  ?  1o9Iai,|<,nI  +  ?  loglA2,k,Nl  "  m  loglBk,Nl »  (4,2) 


where 


Av,k,N  =  m  J(v,k)(2l  ■  J(v,k))(2i  -!S(v.k) 


”  X/  I/O  '  »  V  =  ^ 


(4.3) 


and  Bk  N  is  defined  in  (3.5). 


Take  integer  m  =  mN  and  positive  number  CN  such  that 


N 


N  >>  m  »  CM  ■  log  N. 


(4.4) 


Define  DN,  0.^,  tj,  j  =  l,...,q  by  (3.7)-(3.11).  Then  we  have  the 
following: 


A  A  A 

THEOREM  4.1.  Under  the  conditions  of  the  Case  2,  (q,  tj,  ...,t*)  is 
a  strongly  consistent  estimate  of  (q,  t-j,  ...,t  ). 


To  prove  this  theorem,  we  introduce  the  following: 
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LEMMA  4.1.  Assume  that  yN  =  where 


m  =  mw  as  N  •+■  ®, 


and  z1N,  ...,zmM  are  1.1. d.  random  variables  such  that  the  distribution  of 


z1N  Is  Independent  of  N,  Ez1N  =  0,  and  $(t)  =  E{exp(tz1w)}  is  finite  for 


t|  <  T  with  T  being  a  constant.  Then,  for  any  given  constant  e  >  0  and 


X  >  0, 


P{ |yN|  >  e  log  N}  <  C^' 


where  >  0  is  a  constant. 


Proof.  For  N  large,  X/( vfn e)  _<  T/2.  It  is  easily  shown  that  <j>"  (t) 


is  continuous  for  t  e  [0,  T/2],  and  M  =  sup{  1 4» "  ( t)  | :  0  <  t  <  T/2}  <  ®.  We 


P(yN  1  e  log  N)  <  e"X  logNE 


By  Taylor's  expansion,  and  <fr'(0)  =  0, 


<^x(>4ne))  =  1  +  2-4>"  ( t* )  (  X/  ( i/fn  c ))  2, 


where  0  <_  t*  <  x/(4e)  <_  T/2.  Thus 


P(yN  >  e  log  N)  <  N“A(l  +  X2M/(2e2m))m  <  N"Xexp{X2M/(2e2)  . 


The  same  is  true  for  P(yN  <  -elogN).  Lemma  4.1  is  proved. 


Now  we  give  a  proof  of  Theorem  4.1. 


Proof.  As  before,  there  exist  integers  k®,  ...»  k®,  kg  *  0  <  k^  < 
<  kq  <  kq+i  =  N  such  that  (3.12)  and  the  following  hold. 


’  iy  *  V  for  1  ■  k°-i+1 . 


j  «  1,  2,  ....  q+1. 


(4.5) 


where  El  t  jj2,  ...,yq  t  uq+1 


ib 


§ 


''.SiW',' 


I 


Fix  j  (j  =  1,2 . q),  and  put  k  =  kj.  By  m  «  N,  (3.1)  and  (4.1) 

hold  for  N  large,  where  y(1)  =  y.,  y(2^  =  y.  a*])  =  A.  and  a(2)  =  a.a1. 

-  -J  -j+i  j  j+1 

By  Lemma  3.1  and  Borel-Cantelli 's  lemma,  we  have 


lim  A-i  l  (j  s  Aj i  a.s. 
'»*>”  J 

J^A2.k.N  =  Vl*  3-S- 


(4.6) 


J^Vn  '  i!!|?(A'.k.N  +  A2.k,N)  t?(I(l>k)-!!(2.k))(I(l,k)-I(2,k)>j 

’^Wl1  +  T(Hj  -  Kj+1  ’  'Hj  -  Hj+1  > '  -  a-s-  (4.7) 

H  *  ^(y^  -  Uj+])(vij  -  ijj+-|) '  and  A  = -^(Aj  +  Aj+^).  By  Jensen's  inequality, 
we  have 


2"(  1  °g  i  a  j  |  +  log  I  Aj+1 1 )  +  log  (  a  {  ■>  0. 


(4.8) 


By  (4.2)  and  (4.6)-(4.8),  noting  that  yj  /  Hj+i »  we  have 

J^['mGN(k)]  ^  "7^1o9lAjl  +  1°9 1 Aj+i  I )  +  1  og | A  +  H | 

>  log | A  +  H |  -  log | A|  =  log |  Ip  +  a"1/,2HA_1^2|  >  0.  (4.9) 

Using  the  argument  used  in  establishing  (3.18),  we  see  that  with  probability 
one  for  N  large, 


9  I  q. 


(4.10) 


Take  e  (0,  1/2).  Define  by  (3.19)  and  take  k  e  «N.  By  m  «  N, 

(3.1)  and  (4.1)  hold  with  y^  *  y^2^  *  y.,  and  A^  ■  A^2^  *  A.  for  some 

-  -  -J  j 

j  *  1,  2,  ....  q+1  and  large  N. 


VI  >-2-  a"d 


v”**?i**V1 


Bk.N  =  7(Al,MtA2,k,N>  ByLanm.4.1,  for 

any  e  >  0, 

P{||Av  k  N-  Aj  ||  >  e  log  N/*^n}  <  C^"3,  v  =  1,2, 

(4.1 

P{'||Bk,N- Aj||  >  elogN/^}  <  C-|N~3. 

Note  that  vfn  v >k)  ~  Mj)  *  N{0,  Aj ) »  ^2in  (X^kj  -  y j )  -  N(0,  Aj),  v  ■  1,2. 
Using  (3.27),  we  can  get 

p< H *I(v.k) ■- - Kj)‘ II  i  C2lo9N/m}  <  C,N-3.  v  -  1.2, 

(4.1 

t>{||(I(k)"!!j)(!(k)“!!j),li  lC2logN/m}  <C1N“3, 
provided  the  constant  Cg  Is  large.  By  (4.3)  and  (3.5), 

Av,k,N  “  Av,k,N  ’  (-(v,k)  ”lfj,(-(v,k)  “Kj)'  -  °»  v  "  1,2# 

(4*1 

®k,N  "  Bk,N  =  (?(k)  "Hj)(?(k)  ’Hj)'  -°* 

By  (4.11)  and  (4.12),  for  any  e  >  0, 

P{HAv,k,N  -Aj||  >  elogN/vil  <  ^N-3,  v=l,2, 

P{||Bk,N  -Aj||  >  clogN/y€}  <  C^’3. 

Using  the  argument  similar  to  (3.22)-(3.26) ,  we  have 

PUp(Bk,N)  <  ^p(Aj)}  <  C^’3,  (4.1 

and 

•> 

0  <  m  log | Bk^N |  -  m  log | Bk | 

■  "  '°9|I  ♦  B-]/2(ik>N-BkiN)B-k1tj;2| 

-  m  tr  BM<Sk,N"  -  mHI(k)  ■HjH2/1p(Bk,N)-  (4J 


(•IwS . 


*  .*•  ♦’« 


By  (4.12),  (4.15)  and  (4.16),  when  the  constant  C2  is  large,  we  have 


P{  m  log|Bk>N|  -  m  log  I  Bk  |  >  Cglog  N}  <  (^N 


In  the  same  way,  for  C2  large,  v  =  1,2, 


Pt  J  '  ?  1o9lAv.k.Kl  -  C21og  NJ  <  C,N- 


Denote  by  Xj  '  >_  x2  1  •••  1  Xp  7  the  eigenvalues  of  k  N  for 
v  ■  1,2,  and  denote  by  X-j  >  x2  >  ...  >_  Xp  the  eigenvalues  of  Ky  Put 


=  (x|v)  -  Xi)/Xi,  i  =  1.....P,  v  *  1,2.  By  (3.23)  and  (4.11),  for 


any  e  >  0, 


P{|sjv)|2  >  e  log2N/m,  for  some  1  ,v>  <  C^-3. 


When  | x.j  |  <  1/4,  |y^  |  <  1/4,  1  *  l,...,p,  by  Taylor's  expansion,  there 
exists  a  positive  constant  C3  such  that 


P  ^  ^  y  P 

£^(2  log(l  +  ■  -- y  -)  -  1  og ( ( 1  +x.j)  -  log(l  +yi))  <  C3m  ^(x2  +y2) 


-GN(k)  -«nlog|BM|-5log!A1>M|.5log|A2tM| 


D  C(D  +  C(2) 


p  r  x(1)+x(2) 

5  J  2  log(l  +  — — r-M-log(l  +  61(1))-log(l  +  6|2))  (4. 


Since  m  »  logzN,  there  exists  a  constant  NQ  such  that 


e  logwm  <  1/4  for  N  >_  Nn. 


15 


By  (4.19)-(4.22) ,  for  any  e  >  0,  and  N  >_  NQ, 

P 


P{-GN(k)  >flog2N}  <  C-j N”3  +  P{C3m^(|61(1)|2  +  |6j2)|2)  if  log2N} 

(4.23) 


<  C^"3  +  C^"3, 


By  (4.17)  and  (4.18),  for  any  e  >  0, 

P{l("GN(k))  '  (“Vk))  I  if  1o92n>  <  C-jN"3. 


(4:24) 


By  (4.23)  and  (4.24),  for  any  e  >  0  and  N  i  Nn, 


P{-GN(k)  >  e  log^N}  <  C^"3. 


(4.25) 


Note  that  we  can  choose  the  constants  C1 ,  NQ,  etc.,  independent  of  k  e  KN. 


Since  #(KN)  <  N,  for  N  i  Nq  we  have 


f{-GN(k)  >  logcN,  for  some  k  e  K^}  <  C-jN"2, 


(4.26) 


which  is  the  general  term  of  a  convergent  series.  By  Borel-Cantelli 's 
lemma,  with  probability  one  for  N  large. 


Dty  H  =  0 . 


(4.27) 


Using  the  argument  similar  to  (3.21 )-(3.24) ,  we  can  prove  that  with  proba- 

A  A 

blllty  one  for  N  large,  q  <  q,  q  a  q,  and 

A 

lim  t.  *  t.  a.s.,  j  =  l,2,...,q. 

N-*»  J  J 


The  theorem  is  proved. 
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(5.1) 


5.  THE  CASE  3. 

Following  the  local  likelihood  principle,  we  can  define 

V")  -  5  1°9lAl,|t,Nl  *  ?  1o9IA2,mI  '  m  ,09lBk,Nl- 

where  k  *  m,  m+1 ,  . . . ,  N-m,  and 

\.K,N  =  m  £(v,k)^1  "?(k)^i  “ -(k)^'  v  =  1,2» 

Bk,N  =  Sjf^k)(ii’I(k))(5i’I(k))'* 

A 

Take  m  =  and  satisfying  (4.4),  and  define  D^,  D^.  N,  t j , 
j  *  1 . q  by  (3.7)-(3.11).  Then  we  have: 


THEOREM  5.1.  Under  the  conditions  of  the  Case  3,  (q,  t^ ,  ... ,  tq)  is 
a  strongly  consistent  estimate  of  (q,  t-j ,  ...»  tq). 


(5.2) 


The  proof  is  similar  to  that  of  Theorem  4.1.  Here  we  omit  this 


proof. 


[ 
1 


6.  THE  CASES  4  AND  5 


Put  X.|  3  X(~) •  Take  a  positive  integer  m  <  N:  For  k  =  m, 

m+1,  .  ..,N-m,  we  assume  that  Xkm+j . Xk+m  are  independent  normal 

variables  such  that 


E)Wl  -  -  ■  Exk  *  Exk+1  -  -  ■  Exk*n  *  “(2)- 

^ar(Xk-m+l )  =  =  Var(xk)  = 

Var(Xk+1)  »  ...  3  Var(Xk+m)  3  X(2), 


(6. 


(6. 


Similar  to  (3.3),  we  can  define  X^  kj,  kj  and  X^. 

First  we  consider  the  case  4.  In  this  case,  we  assume  that 
x(l)  «  x(2)  _  and  pO)f  x  are  all  unknown. 

The  logarithm  of  the  LRT  statistic  for  testing  the  null  hypothesis 
Hk:  y^  =  y^  against  the  alternative  Kk:  y^  >  y^  is  given  by 

GN(k)  3  K^(1>k)  >  *(2,k))m  1og(Ak,N/Bk,N)’  (6* 

where  1(A)  denotes  the  indicator  of  a  set  A,  and 


Take  m  ■  mN  and  such  that 

N  »  m  »  CN  >>  log  N.  (6. 

Define  D^,  Dj  N,  tj,  j  3  l,...,q  by  (3.7)-(3.11 ) .  Then  we  have  the 
following: 
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A  A  A 

THEOREM  6.1.  Under  the  conditions  of  the  Case  4,  (q,  t-j . t^)  Is 

a  strongly  consistent  estimate  of  (q»  tj, ...»  tq). 


Now  we  consider  the  Case  5,  and  we  assume  that  (6.1)  and  (6.2)  hold, 
and  y<]\  x^,  y^,  X^  are  all  unknown. 

It  can  be  proved  that  the  logarithm  of  the  LRT  statistic  for  testing 
the  null  hypothesis  H.  :  y^  *  y^»  X^  »  x^  against  the  alternative 


Kk:  y^  >  y^2^  and  X^,  X^  are  arbitrary  is  given  by 


GN,k)  *  Iff(kik)  >y(2,k))[?  1o9  Al,k,N  +  7  1os  A2*k,M  ~  m  ,og  Bk,N} 
♦  I(y(l,k)iy(2,k)>{?  109  A<1>(k)+?  l09  *(2)<k> 

-  m  109  Bk.N]' 


(6.6) 


where 


Al,k.N  =  m  £(l,k)(X1  "X(l,k)}2> 
A2,k,N  =  m  ^(2,k)(X1  "^(2,k))  , 
Bk,N  *  Ii^(k)(Xi"X(k))2» 


(6.7) 


and  X^'(k),  x'^'(k)  satisfy  the  following  conditions: 


.  'll  »k)  “  (2,k 
+  ,  \i:i - X7TT 


X(1,(k)  +  (x(1J(k))*  1,k,N  (x(1,(k)  +  X(2'(k)) 


(6.8) 


(*'l,k)  "*(2fk)) 


T  (xls'(k>)5  A2-k-N  * 


The  proof  of  (6.6)  is  routine,  and  is  omitted. 
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Take  integer  m  =  m^  and  positive  number  such  that 

N  »  m  >>  =  log2N.  (6.9) 

Define  D^,  DJ(N,  ty  j  *  l,...,q  by  (3.7)-(3.11).  Then  we  have  the 
following: 

*  A  A 

THEOREM  6.2.  Under  the  conditions  of  the  Case  5,  (q,  t] ,  ....  t*) 
is  a  strongly  consistent  estimate  of  (q,tp  ...,t  ). 

Since  the  proof  of  Theorem  6.1  is  similar  to  that  of  Theorem  6.2, 
we  only  give  the  proof  of  Theorem  6.2. 

Proof  of  Theorem  6.2.  It  is  aasily  seen  that  there  exists  integers 
kl*  •••*  kq»  ko  s  0  <  k!J  <  ...  <  K°  <  k°+1  =  N  such  that 

!k° 

tj  <,  1/N,  for  j  *  1,2,...  ,q,  (6.10) 

and 

y(^)sWj»  A(j^-)  ~  ^  =  kj_j+1  »•  •  •  *kj  *  J  -  1 . q+1 »  (6.11) 

where  V]  >  y£  >  ...  >  yq+r 

Fix  j,  j  *  l,2,...,q,  and  put  k  *  k°.  Since  m  «  N,  (6.1)  and  (6.2) 
hold  for  N  large,  where  y^  *  yj  >  y^  *  yj+i»  and  x^  *  *j»  X^  *  Xj+-|. 
It  can  be  proved  that  with  probability  one  for  N  large,  X^kj  >  ^(2,k)* 
and  by  (6.6) 

-l6N(k)  -  logBkjN  -  ^logA,^  -  ^-log  (6,12) 

By  Lemma  3.1  and  Bprel-Cantelli's  lemma,  we  have 
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Tim  A,  l  u  =  ^ j i  3 • s • 

A2,k,N  =  Xj+1»  a*s* 


Bk,N  =  +  Xj+1^  +  '  pj+l^'  a-Si 


(6.13) 


(6.14) 


(Refer  to  (4.7)).  Along  the  line  of  proof  from  (4.8)  to  (4.10),  we  see 


that  with  probability  one  for  N  large. 


Q  1  q. 


(6.15) 


Take  e  (0,  1/2).  Define  by  (3.19)  and  take  k  e  KN.  By 
m  «  N,  (6.1)  and  (6.2)  hold  with  =  Uj  and  A(1)  =  A(2*  =  Aj 

for  some  j  ■  l,2,...,q+l  and  for  large  N. 

Put  A^(k)  =  x,  A^(k)/A^(k)  *  z,  AUk  N  =  a,  A2^N  *  b  and 

_  O 

(X^  k)”^(2  k)'  =  c*  The  e<luat*on  (6*8)  can  be  rewritten  as 


1  .  a  .  1 

'*  7 

j.  t>  .  i 

xz  "  2.2 


xfczc  xc(l  +  z)‘ 


(6.16) 


(6.17) 


It  is  easily  seen  that  with  probability  one  we  have  a  >  0,  b  >  0  and 


c  >  0.  Multiplying  both  sides  of  (6.16)  by  x  ,  we  get 

x  =  — - — n-  +  a. 

(1+z)2 


(6.18) 


Multiplying  both  sides  of  (6.17)  by  x  ,  substituting  (6.18)  into  it, 

2  2 

and  multiplying  both  sides  of  the  obtained  equation  by  z  (1+z)  ,  we 


az(l  +  z)2  -  b(l  +  z)2  -  cz2  +  cz  =  0. 


(6.19) 


Lv;y 


Equation  (6.19)  has  at  least  one  real  solution  which  is  neither  0  nor  -1, 
and  If  2  t  -1  is  real,  a  +  c/(l  +2)  >0.  Hence,  by  means  of  the  above 
method  of  solution,  we  guarantee  that  the  equation  system  (8)  and  the 
system  of  equations  (6.18),  (6.19)  have  the  same  real  solution.  Also,  any 
real  solution  of  (8)  must  be  positive.  We  denote  by  (x^(k),  x^(k)) 
such  a  solution  of  (8).  By  (6.8), 

li<1)<k>-''l,k.Nt/(J(1)(k>)Z  *  ^(1.k)-‘5r(2.k))2/(J(,)<k>+J<2)(^)Z 


which  implies  that 


l*(1)(k)  ‘  At,k,Nl  <  (X(l,k)  “X(2,k))2, 


(6.19) 


In  the  same  way, 


(k)“A2,k,Nl  <  (*(l,k)  '  X(2,k)}  ‘ 


(6.20) 


Write 


Gj(k)  "  I^Vk.N  +  ?l09A2.k,N  -  ml°9Bk,l 


(6.21) 


I  1  iw  I  I 

*  /  1  \  w  2) 

G„(k)  -  Gjfk)  I  <  5  log  V  +TT  1°9  V  (k)  •  (6.22) 

"  "  i  Sl,k,N  2,k,N 

By  (4.12),  (4.14)  with  p  =  1 ,  and  ( 6 . 1 9 ) - (6 . 22 ) ,  it  is  easy  to  verify 


that  for  any  e  >  0, 


P{  |GN(k)  -  6*<k)  |  >  e  log2N}  <  C^'3,  (6.23) 

where  >  0  is  a  constant  independent  of  k  e  KN< 

Since  Gjj(k)  is  just  GN(k)  of  (4.2)  with  p  =  1,  the  rest  of  the  proof 
has  already  been  given  in  the  second  part  of  the  proof  of  Theorem  4.1. 
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Thus  we  have  with  probability  one  for  N  large,  q  <_  q,  q  =  q,  and 
jHmtj-tj,  a.s.,  J  -  1.2 . . 

Theorem  6.2  Is  proved. 
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